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Abstract — This paper is concerned witli an important matrix 
condition in compressed sensing Itnown as tlie restricted isometry 
property (RIP). We demonstrate that testing whether a matrix 
satisfies RIP is NP-hard. As a consequence of our result, it is 
impossible to efficiently test for RIP provided P / NP. 



I. Introduction 

It is now well known that compressed sensing offers 
a method of taking few sensing measurements of high- 
dimensional sparse vectors, while at the same time enabling ef- 
ficient and stable reconstruction [1]. In this field, the restricted 
isometry property is arguably the most popular condition to 
impose on the sensing matrix in order to acquire state-of-the- 
art reconstruction guarantees: 

Definition 1. We say a matrix $ satisfies the (K, 6)-restricted 
isometry property (RIP) if 

{l-d)\\xf < ll^xlp < (1 + ,5)||.t||2 

for every vector x with at most K nonzero entries. 

To date, RIP-based reconstruction guarantees exist for Basis 
Pursuit m, CoSaMP Q and Iterative Hard Thresholding Q, 
and the ubiquitous utility of RIP has made the construction 
of RIP matrices a subject of active research l|5]-[j7|. Here, 
random matrices have found much more success than de- 
terministic constructions [5|, but this success is with high 
probability, meaning there is some (small) chance of failure 
in the construction. Furthermore, RIP is a statement about the 
conditioning of all (^) submatrices of an M x N sensing 
matrix, and so it seems computationally intractable to check 
whether a given instance of a random matrix fails to satisfy 
RIP; it is widely conjectured that certifying RIP for an 
arbitrary matrix is NP-hard. In the present paper, we prove 
this conjecture. 

Problem 2. Given a matrix $, a positive integer K, and 
some 5 € (0, 1), does $ satisfy the (K, 5)-restricted isometry 
property? 
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In short, we show that any efficient method of solving 
Problem|2]can be called in an algorithm that efficiently solves 
the NP-complete subset sum problem. As a consequence of 
our result, there is no method by which one can efficiently 
test for RIP provided P 7^ NR. This contrasts with previous 
work jS), in which the reported hardness results are based 
on less-established assumptions on the complexity of dense 
subgraph problems. 

In the next section, we review the basic concepts we will 
use from computational complexity, and Section 3 contains 
our main result. 

II. A BRIEF REVIEW OF COMPUTATIONAL COMPLEXITY 

In complexity theory, problems are categorized into com- 
plexity classes according to the amount of resources required 
to solve them. For example, the complexity class P contains 
all problems which can be solved in polynomial time, while 
problems in EXP may require as much as exponential time. 
Problems in NP have the defining quality that solutions can 
be verified in polynomial time given a certificate for the 
answer As an example, the graph isomorphism problem is 
in NP because, given an isomorphism between graphs (a 
certificate), one can verify that the isomorphism is legitimate 
in polynomial time. Clearly, P C NP, since we can ignore the 
certificate and still solve the problem in polynomial time. 

While problem categories provide one way to describe 
complexity, another important tool is the polynomial-time 
reduction, which allows one to show that a given problem 
is "more complex" than another To be precise, a polynomial- 
time reduction from problem A to problem i? is a polynomial- 
time algorithm that solves problem A by exploiting an oracle 
which solves problem B; the reduction indicates that solving 
problem A is no harder than solving problem B (up to 
polynomial factors in time), and we say "A reduces to B" 
OT A < B. Such reductions lead to some of the most popular 
definitions in complexity theory: We say a problem B is called 
NP-hard if every problem A in NP reduces to B, and a 
problem is called NP-complete if it is both NP-hard and in 
NP. In plain speak, NP-hard problems are harder than every 
problem in NP, while NP-complete problems are the hardest 
of problems in NP. 

Contrary to popular intuition, NP-hard problems are not 
merely problems that seem to require a lot of computation to 
solve. Of course, NP-hard problems have this quality, as an 
NP-hard problem can be solved in polynomial time only if 
P = NP; this is an open problem, but it is widely believed 
that P 7^ NP |9|. However, there are other problems which 
seem hard but are not known to be NP-hard (e.g., the graph 
isomorphism problem). As such, while testing for RIP in the 
general case seems to be computationally intensive, it is not 
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obvious whether the problem is actually N P-hard. Indeed, by 
the definition of N P-hard, one must compare its complexity 
to the complexity of every problem in NP. To this end, notice 
that A < i? and B < C together imply A < C, and so to 
demonstrate that a problem C is N P-hard, it suffices to show 
that B < C for some N P-hard problem B. 

In the present paper, we demonstrate the hardness of certi- 
fying RIP by reducing from the following problem: 

Problem 3. Given a matrix 5* and some positive integer K, 
do there exist K columns of 4" which are linearly dependent? 

Problem |3] has a brief history in computational complex- 
ity. First, McCormick IfTOl demonstrated that the analogous 
problem of testing the girth of a transversal matroid is NP- 
complete, and so by invoking the randomized matroid rep- 
resentation of Marx ITTI . Problem |3] is hard for NP under 
randomized reductions {lT\. Next, Khachiyan [13] showed that 
the problem is N P-hard by focusing on the case where K 
equals the number of rows of using a particular matrix 
construction with Vandermonde components, he reduced this 
instance of the problem to the subset sum problem. Recently, 
Tillmann and Pfetsch 1 14| used ideas similar to McCormick's 
to strengthen Khachiyan's result: they prove Problem |3] is 
N P-hard without focusing on such a specific instance of 
the problem. Each of these complexity results use M x N 
matrices with integer entries whose binary representations take 
< p(Af, N) bits for some polynomial p; we will exploit this 
feature in our proof. 

III. Main result 
Theorem 4. Problem\2\is NP-hard. 

Proof: Reducing from Problem |3] suppose we are given 
a matrix ^ with integer entries. Letting Spark(^') denote the 
size of the smallest collection of linearly dependent columns 
of 5*, we wish to determine whether Spark(\I>) < K. To this 
end, we take P < 2^^*^'^^ to be the size of the largest entry in 
^, and define C = 2^^°S2 Vmnp] $ = i^i; note that we 
choose C to be of this form instead of %/ MN P to ensure that 
the entries of ^ can be expressed in poly(Af, N) bits without 
truncation. Of course, linear dependence between columns is 
not affected by scaling, and so testing <i> is equivalent to testing 
^f. In fact, since we plan to appeal to an RIP oracle, it is 
better to test $ since the right-hand inequality of Definition [T] 
is already satisfied for every S > 0: 

-P 



i$ii2 < VMN\m 



VJiN- < 1 < Vl + S. 



We are now ready to state the remainder of our reduction: 
For some value of S (which we will determine later), ask the 
oracle if $ is {K, d)-RlP; then 



(i) $ is {K, 6)-RlP 

(ii) $ is not (K, (5)-RIP 



Spark(*) > K, 
Spark(*) < K. 



The remainder of this proof will demonstrate (i) and (ii). 

Note that (i) immediately holds for all choices of S E (0, 1) 
by the contrapositive. Indeed, Spark ('5) < K implies the 
existence of a nonzero vector x in the nullspace of $ with 



< K nonzero entries, and ||$a;|p = < (1 — violates 
the left-hand inequality of Definition [T] For (ii), we also 
consider the contrapositive. When Spark(^') > K, we have 
that every size-K subcoUection of ^P's columns is linearly 
independent. Letting ^fyc denote the submatrix of columns 
indexed by a size-K subset K, C {!,..., N}, this implies that 
Amin(*K*K;) > 0' ™d so det(^';;;^'^) > 0. Since the entries 



of ^ lie in {-P, . 



, P}, we know the entries of ^'J^f^^ 



lie in {-AfP^, . . . , AfP^}, and since ^J^^y^ is integral with 
positive determinant, we must have det(5'5^5'^) > 1. In fact, 

1 < det(*;^*^) 

K 



fc=i 



<Xnun{^h^K)-{K\\^h'i' 



K 1 1 max; 



and so we can rearrange to get 



Amin($K*K) 



> 



C^{KMP 



2\K-l 



> 2 



-5MNp{M,N) 



where the last inequality follows from K < M < N and other 
coarse bounds. Therefore, if we pick 6 :— I — 2^^^^^p^^^-'^\ 
then since our choice for K, was arbitrary, we conclude that <& 
is {K, (5)-RIP whenever Spark(5') > K, as desired. Moreover, 
since S can be expressed in the standard representation using 
poly(A4^, N) bits, we can ask the oracle our question in 
polynomial time. ■ 
It is important to note that Theorem |4] is a statement about 
testing for RIP in the worst case; this result does not rule out 
the existence of matrices for which RIP is easily verified (e.g., 
using coherence in conjunction with the Gershgorin circle 
theorem for small values of K Q). 
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